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SYSTEM AND METHOD FOR GUIDING 
FLEXIBLE INSTRUMENT PROCEDURES 

CROSS-REFERENCE TO RELATED APPLICATIONS 

5 This is a non-provisional application claiming the 

benefit of provisional application Ser. No. 60/266,954, 
filed on February 7, 2001, the disclosure of which is 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
10 1 . Field of the Invention 

The. present invention relates to guiding endoscopic 
procedures, and more particularly to guiding a flexible 
instrument . 

15 2 . Discussion of Related Art 

Transbronchial needle aspiration (TBNA) is a valuable 
minimally invasive procedure in the bronchoscopic diagnosis 
and staging of patients with lung cancer. The procedure 
allows nonsurgical access to lymph nodes from the inside of 

20 the tracheobronchial tree. Typically, a biopsy can be 

performed by maneuvering a bronchoscope to a desired site 
within the tracheobronchial tree. The surgeon can insert a 
tool, for example, a needle, through the bronchoscope and 
puncture the bronchial wall to hit a target behind, e.g., a 

25 tumor. This is literally a "blind" puncture since the 
target object is at no time visible through the 
bronchoscope. To increase the chance of hitting the target, 
a surgeon may take more than one tissue sample for every 
biopsy. Studies have shown that up to eight needle 

30 aspirations in the same site can be safely performed. 

However, there is no strategy for placing the aspirations 
other then a trial-and-error approach. 



1 




Express Mail Label No. EL727967940US 



Despite the fact that the surgeon can perform more 
than one needle aspiration in a single biopsy, this 
procedure has a failure rate of about 60 to 80%, if the 
bronchial wall is not yet affected. The blind nature of the 
5 procedure and the physician's lack of confidence about 
where to position the needle are obstacles to the 
widespread use and positive diagnostic yield of TBNA. 
Performing a TBNA can include three-dimensional (3D) 
imagination (coordination of the learned three dimensional 

10 anatomy with a fish-eye distorted 2D video image) together 
with the handling of the endoscope (hand-eye-coordination) . 

Techniques used to guide TBNA can be classified into 
three different groups: imaging based technology, on-line 
visualization of the target and tracking of the 

15 bronchoscope . 

Imaging based techniques can include, for example, 
fluoroscopy, CT and CT fluoroscopy. These techniques can 
show the endoscope, the advanced needle and the target 
lesion. Fluoroscopy produces a real-time two-dimensional 

20 image projection with poor contrast. Typically, the target 
lesion is not visible. Conventional CT produces images of 
adequate quality but the procedure can be cumbersome and 
time consuming since real-time imaging may not be possible 
and each sequence needs to be prescribed in advance. CT 

25 fluoroscopy is a term for continuous -imaging CT that allows 
the visualization of dynamic processes in real-time, like 
the insertion of a needle into the target lesion. However, 
this technique is limited to axial images and may need 
significant CT-scanner time and relatively high radiation 

3 0 dosage. 

On-line visualization can include, for example, 
techniques that visualize the target lesion by inserting an 
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ultrasound transducer through a working channel of the 
bronchoscope. There is no significant difference in 
sensitivity compared to unguided TBNA. 

Tracking methods can include techniques that track the 
5 tip of the bronchoscope in real-time to guide the TBNA. For 
example, tracking the bronchoscope's tip by processing the 
endoscope images. The Biosense intra-body navigation system 
uses electromagnetic fields to track a sensor that can be 
attached to the bronchoscope's tip. In an in vivo study , 
10 ten to twenty markers were secured on a test subject's 
chest and the respiratory motion was monitored using a 
second sensor to compensate for breathing motion. The study 
showed an accuracy of 4.2 mm +-2.6 mm (+- SD) . 



15 a flexible instrument using predetermined models. 

Therefore, a need exists for a method of blindly guiding a 
flexible instrument according to a predetermined patient 
specific model . 



According to an embodiment of the present invention, a 
method is provided for determining instructions for 
handling a flexible instrument . The method comprises 
parameterizing the flexible instrument according' to a 

25 plurality of parameters for handling the instrument, 

determining at least one instrument configuration, wherein 
the configuration describes at least one parameter, and 
determining instructions for handling the instrument 
according to the configuration. 

3 0 Parameterizing further comprises determining an 

instrument length. Parameterizing further comprises 
determining a shaft rotation of the flexible instrument. 



However, no known system or method exists for guiding 
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Parameterizing further comprises determining an angle of 
deflection of a tip of the instrument. Parameterizing 
further comprises determining a tool length. 

The configuration comprises a value for at least one 
5 parameter. The configuration describes at least one 

parameter that docks the flexible instrument with a target. 
One or more parameters of the configuration are determined 
relative to an anatomical landmark. 



method is provided for determining instructions for 
handling a flexible endoscope. The method comprises 
parameterizing the flexible endoscope according to a 
plurality of parameters for handling the endoscope given a 

15 desired task, and determining, pre-operat ively , at least 
one endoscope configuration of the parameters, based on a 
predetermined patient model. The method further comprises 
determining instructions for handling the endoscope 
according to the configuration. 

20 The method comprises determining a digital model of a 

flexible instrument . 

The method comprises registering a patient to the 
predetermined patient model. The method comprises 
identifying a mutual landmark visible in the patient and in 

25 the predetermined patient model. The method comprises 

determining a configuration relative to a landmark. The 
landmark is a carina of a tracheobronchial tree. 

Parameterizing further comprises determining an 
endoscope length parameter. The method comprises inserting 

3 0 the endoscope model to a landmark, and inserting the 

endoscope model to a target site, wherein a distance to the 
target site from the landmark is a difference between a 
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The method comprises determining a patient model. 
According to an embodiment of the present invention, a 
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total distance from a reference point to the target site 
and an intermediate distance from the reference point to 
the landmark. 

Parameterizing further comprises the step of 
5 determining a shaft -rotation of the endoscope according to 
a landmark. The method comprises determining an angle 
between a bending plane of a tip of the endoscope model and 
the target . 

Parameterizing further comprises the step of 
10 determining a bending angle of the endoscope. Determining 
the bending angle comprises approximating a bending 
movement by a semi-circle with a given center, determining 
a vector between the center and the tip of the endoscope 
model, determining a vector between the center and the 
15 target, determining the angle between both vectors. 

Parameterizing further comprises the step of 
determining a tool length and more specific a distance 
between the tip of the instrument and the target. 
Determining the tool length comprises determining the 
2 0 distance between the aligned tip of the endoscope model and 
the target . 

According to an embodiment of the present invention, a' 
system is provided for monitoring the configuration of a 
flexible instrument. The system comprises an endoscope 

25 comprising a wheel and wheel angle-scale for determining a 
tip deflection of the endoscope, a stopper fixed to a shaft 
of the endoscope, a pointer fixed to the shaft of the 
endoscope, and a mouth-piece comprising an angle-scale, 
wherein the angle-scale is a reference point for the 

30 pointer for determining a shaft -rotation . 
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The stopper is fixed to a position on the shaft 
according to a distance from the mouth-piece to the target 
site. The shaft passes through the mouth-piece. 

5 BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments of the present invention will be 
described below in more detail, with reference to the 
accompanying drawings : 

Fig. 1 is a diagram of an endoscope according to an 
10 embodiment of the present invention; 

Fig. 2a is an illustrative diagram of a 
tracheobronchial tree and possible endoscope arragnements 
according to an embodiment of the present invention; 

Fig. 2b is an illustrative diagram of a 
15 tracheobronchial tree and references according to an 
embodiment of the present invention; 

Fig. 3 is an illustrative diagram of an endoscope and 
a patient according to an embodiment of the present 
invention; 

2 0 Fig. 4 is an illustrative set of instuctions according 

to an embodiment of the present invention; and 

Fig. 5 is a flow chart of a method according to an 
embodiment of the present invention. 

2 5 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

According to an embodiment of the present invention, 
an endoscopic procedure can be guided according to a 
predetermined method. The method of guiding the instrument- 
can be based on a parameterization of the instrument and a 

3 0 plurality of instrument configurations determined to 
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accomplish a goal. The method of guiding the instrument can 
be implemented with or without the aid of a computer. Thus, 
costs, including for example, setup time, associated with 
an intervention using a method according to the present 
5 invention can be substantially less than for procedures 
which implement computer technology in an operating 
theater . 

For example, a bronchoscope can be described relative 
to a landmark. Referring to Fig. 1, these parameters can 
10 include: Bronchoscope insertion depth 1 (1); shaft rotation 
about the principal axis a (2) ; an angle of tip detection 3 
controlled by an angling wheel (3) ; and a needle length d 
(4) . 

These parameters can be denoted as endoscope 

15 configuration C = (1, a, (3, d) . An instrument can be 

described by one or more configurations. The configurations 
can be described as a method for performing a task, for 
example , a TBNA. 

A method of guiding a flexible instrument according to 

20 the present invention can increase a probability of success 
for a TBNA by providing these parameters and detailed step- 
by-step instructions to a user, e.g., a surgeon. The 
instrument parameters and configurations can be determined 
prior to the intervention. 

25 A patient specific model can be determined, for 

example, by a CT scan or an MRI . For example, the patient 
specific model can show a tracheobronchial tree derived 
from a CT scan. By registering the patient to the patient 
model, a task, e.g., biopsy, can be simulated by 

3 0 determining the possible endoscope configurations that 
reach the target site given the parameters of the 
instrument relative to the patient. 
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From the instrument configurations, one or more 
frequency distributions can be determined for each 
parameter. In the case of TBNA, to exploit the fact that 
several aspirations can be performed for one biopsy, 
5 several sets of the v - most frequent parameters can be 

selected from these distributions. During the intervention 
a method of guiding a flexible instrument can be used to 
monitor the parameters; the method is an example of a 
passive control. Thus, the aspirations can be performed 
10 systematically. The instrument's parameters can be 

determined relative to the patient' s model or reference 
frame, which can be registered according to an anatomical 
landmark . 



15 bronchoscope, takes physical characteristics, including for 
example, flexibility, bending section, diameter and length 
of the bronchoscope into account. The bending section of 
the bronchoscope is its flexible distal end. It can be 
controlled using the angling wheel located at the 

20 bronchoscope's control head, to look around and guide the 
needle to the target . 

Fig. 2a shows an example of the components of a TBNA. 
It shows the tracheobronchial tree 2 00 and a target mass 
(T) outside the airways. The planned biopsy site B is shown 

25 in form of the endoscope's tip together with two possible 
shaft shapes. Note, that B is the position and orientation 
of the tip before the alignment and therefore does not need 
to point towards the target. The calculation of the 
protocol parameters 1, a, (3, d can be based on a model M of 

3 0 the bronchoscope and comprises preoperat ively planning 
biopsy site B, determining the bronchoscope length 1 to' 
reach B:1=M(B), determining the endoscope -space E to reach 



A model of the flexible instrument, e.g 
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B with length 1: E =M(1,B), and for all eGE: determining 

a(e) , p=M(e) , d=M(e) . 

The physician preoperat ively plans a biopsy site. The 

biopsy site B represents roughly the position and 
5 orientation of the bronchoscope's tip within the 

tracheobronchial tree from where to perform the biopsy. 
A TBNA procedure can be considered as a two step 

method: (1) inserting the bronchoscope into a branch that 

includes the target-site and (2) aligning the bronchoscope 
10 with the target lesion. This allows the method to fix the 

inserted length 1 and to determine the alignment parameters 

a, (3, d based on the fixed inserted length. 

Instrument model M can be used to determine a set of 

instrument shapes or configurations where each element 
15 represents an instrument of length 1 that reaches into the 

branch including the target site B. This set of shapes can 

be referred to as the endoscope-space E, since it describes 

the possibilities of a real instrument, e.g., bronchoscope, 

to reach the target site. 
20 Given the endoscope-space E, a method determines for 

each endoscope shape the alignment parameters a, p, d. For 

(3 and d, alignment parameters can be determined according 

to a bending section model . 

To register the insertion depth 1 and shaft rotation a 
25 to the patient's reference frame, a landmark based method 

can be used. For example, the carina, a keel -shaped part of 

the tracheobronchial tree that marks the bifurcation of the 

trachea into the left and right lung, can be used as an 

anatomical landmark . 
3 0 Figures 2a and 2b show a biopsy- site B and two 

possible endoscope lengths 201-202 from B to the point of 

reference R. The point of reference can be chosen to lie in 
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a bottleneck 203 (e.g., vocal chords) in terms of all 
possible paths the instrument can take. To determine the 
bronchoscope length to B measured from M, the physician can 
touch the landmark L with the bronchoscope 2 04 and insert 
5 (or withdraw for lesions proximal to the carina) the 
bronchoscope by the difference between RB and RL . 

As the mutual zero-point for the shaft -rotation, the 
rotation of the bronchoscope that shows the carina to 
appear vertically can be selected. This rotation registers 

10 the patient to the patient's model, and can be the basis 
for the instrument parameters. In a planning phase the 
physician can rotate a virtual endoscopic camera and during 
the intervention rotate the bronchoscope until the views 
show the carina to appear vertically. 

15 To set the bronchoscope to the configuration given by 

the instrument parameters, control over the inserted length 
1, the shaft rotation a, the tip detection (3 and needle 
length d is needed. Referring to Fig. 3, since the needle 
aspirations can be performed based on a fixed bronchoscope 

20 length, a stopper 301 can be used to prevent the 

bronchoscope 3 02 from penetrating the body deeper than 
desired. To control shaft rotation, a goniometer 303 
(angle-scale) can be attached to the base plate 304 of the 
mouth-piece and a pointer 305 to the stopper 301. When the 

25 base plate 304 stops the insertion of the bronchoscope 302, 
shaft rotation moves the pointer 305 along the angle-scale 
303. The tip bending can be controlled with an angle-scale 
attached to the angling wheel 306 located at the 
bronchoscope's control head. 

3 0 During the planning phase, a look-up table can be used 

to map the angle of tip deflection to the wheel angle. A 
tool length, e.g., needle length, can be controlled 
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according to marks on its proximal end and using the 
opening of the biopsy port as a reference point. 

Fig. 4 shows a TBNA- protocol according to an 
embodiment of the present invention. It can be divided into 
5 three parts: Lines 1-5 comprise the registration 

instructions and lines 6-7 describe the insertion or 
withdrawal of the bronchoscope to the biopsy- site. Lines 8- 
10 describe the alignment of the bending section with the 
target lesion. Parameters 1, a, d represent the patient 

10 specific part of the protocol. The instructions themselves 
can remain substantially unchanged for different patients. 
Depending on the location of B relative to the current 
endoscope position, the left or right column of lines 6-7 
can be executed. After execution of line 7, the \ 

15 bronchoscope reached the biopsy- site and the following 
instructions 8-10 use parameters a, (3, d to align the 
bronchoscope with the target lesion. The arrow indicates 
that a series of biopsies can be performed systematically. 
Fig. 5 shows a method for guiding a flexible 

20 instrument, e.g., an endoscope, to a target site. The 

method comprises determining the target site reachable by a 
flexible instrument 501, determining a length for the 
instrument to reach the target site 502, and determining a 
shaft rotation for the instrument to rotate a bending plane 

25 of the instrument's tip into the target 503. The method 
further comprises determining a bending angle for the 
instrument's tip to align the tip with the target 504, 
determining a distance for a tool inserted through the 
instrument to dock to the target 505, and determining a 

30 value for the parameter in 502 and 503, which is given 
relative to an anatomical landmark 506. The method 
comprises determining a passive control for each parameter 
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in 502, 503, 504 and 505 that allows for the monitoring of 
the respective parameter's current value during the 
procedure 50 7. 

The instrument model M describes a flexible endoscope 
5 as a chain of rigid cylinders interconnected by discrete 
ball-and-socket joints. The chain interacts with the 
patient specific anatomical model via a collision detection 
method. Each cylinder of the chain can be approximated by a 
cloud of sample points on its surface. Checking for 

10 collision of all sample points with the organ model allows 
us to verify whether a chain configuration represents a 
valid endoscope shape. The flexibility of the chain can be 
modeled by the choice of link length s (span) and joint 
range 0 and is based on the notion of minimal radius. Thus, 

15 a method can exhaustively enumerate all possible chain 

configurations, given a start cylinder and a plurality of 
constraints. These constraints can include, for example, 
organ geometry, gravity, medial -axis and stopping-criteria. 
Using a recursive backtracking method, a tree data 

2 0 structure can be created where the nodes represent joints 

of the chain. The bending section (e.g., 95 mm long) can be 
modeled accurately to reflect the properties of a real 
bronchoscope . 

A link can be represented by a reference frame (4x4 
2 5 homogeneous transform matrix) L, where the centerline of 
the cylinder is the z-axis of the frame and the cylinder 
bases lie in the z = 0 and z = s plane. Given a link Li of 
level i, the nine connected links of the next level can be 
given by: 

30 L J M = R(r J ,e)L i T(z S \forj = l,...,9, 
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where T is a translation and R a rotation matrix, 



x,y,z denote the three 4x1 unit vectors, rj is the j th 

rotation vector of the set {(xyO) 7 | x 9 y e {- 1,0,1}} and 0 is the 
rotation angle . 



5 



For determining the length of the endoscope needed to 
reach a target link (e.g., biopsy-site), the stopping 



criteria can be determined to be fulfilled when a link L 



10 



docks to the target link. For determining the endoscope- 
space E the stopping criteria can be the recursion depth. 
For each path from the root to a leaf, alignment 



parameters can be determined. The shaft rotation a is 
dependant on the orientation of the bronchoscope's bending 
plane. The bending plane of an endoscope is the plane in 
which the tip moves under the rotation of the bending wheel 
15 at the endoscope's control head. Let tip link L and target 
vector t be known with respect to the same global reference 
frame and let L' s y = 0-plane be the bending plane. The 
desired shaft rotation is the rotation angle about z that, 
rotates the y = 0-plane into target t: 



The left-hand-side of the formula calculates the angle 
between unit vector x and t' . Vector t' equals t known with 
respect to L and orthogonally projected into the z=0 -plane. 
After shaft rotation, target t lies in the y = 0 

2 5 bending plane and the method determines the angle of 

bending wheel rotation needed to align the tip with t. The 
transition point q from the shaft to the bending section 
determines the angle of wheel rotation. The bending 
movement of the straight tip to the left and right can be 

30 approximated by a semi-circle with its center c = 49 mm 



20 
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away from the endoscopes end. A link Q of the chain can be 
determined that includes q. The link can be moved along its 
£ -axis by a = 95 - 49 = 46 mm. The new origin of Q can be 
considered as the center of the semicircle. 

The desired angle of wheel rotation can be given by 
the angle between z and target t : 



( 



(3 = cos" 1 



with Q'=QT(za) . Needle length d = \Q~ l t\-c 



This approach has been implemented on a SGI PC54 0, 

10 550Mhz (single), 0.5 GB RAM, running Windows 2000 and 

OpenGL. A lung phantom was built using transparent (for 
visual verification) PVC cylinders. Thirty-seven marker 
sticks (4 mm diameter, cardboard) were randomly placed in 
the model so that they are aligned with the inner surface 

15 of the cylinders. The phantom was then scanned 

(512x512x382, 1 mm slice distance, 1.2 thickness). After 
the scan, the surface points were manually identified as 
target points. The lung phantom is 1.5 times the size 
(trachea diameter: 30 mm) of an adult lung, to compensate 

20 for the fact that a "Gastrointestinal Videoscope" (Olympus 
GIF 100, shaft diameter: 9.5 mm) was used for the 
experiments, the Videoscope being about 1.5 times the 
diameter of an endoscope. 

Out of all 37 markers five were selected as target 

25 points, three of them close to the carina. For 

each target, the protocol was executed 20 times and record 
the configuration parameters needed to touch the marker 
stick with the biopsy needle. Note, that the markers can be 
seen by the endoscopic video camera as a white 4 mm disk. 
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To estimate the parameters for each target, a method 
generates for each parameter a dataset of at least 100 (and 
up to 25,000) measures. Each dataset can be read with a 
data-analyzing package (IDL, Research System, Inc.) and 
5 create frequency distributions to draw histograms and 
calculate the mean and standard deviations. 

Repeatability: To calculate the variation of the 
experimentally obtained parameters, the smallest and 
largest outlier of all 15 datasets (20 measures each) were 
10 rejected and the range of each dataset was determined. The 

*v '%- 

largest range of a, (5 and d were determined to be 7°, 6° 
and 7 mm and the average range to be 6°, 4° and 4 mm 
respectively. 

Accuracy of the prediction: The real error of a 

15 configuration C = (a, (S, d) is given by the distance 

between the target point and the needle tip after setting 
the endoscope to configuration C. Since it may not be 
possible to measure distances inside the plastic model, a 
theoretical error model was used to obtain an upper bound 

2 0 error estimation for the parameter prediction. Results 

show, that shaft rotation a is by far the most sensitive 
parameter with an average error of 12°, whereas (3 (3°) and 
d (1 mm) can be predicted more accurately. To exploit 
this fact, a test was performed where the configuration 

25 (a,/?,<i) was taken for the first aspiration, {a + cr,j3,d) for 
the second and (a -<r, /?,</) for the third, where the dashed 
parameter denotes the mean and o the standard deviation of 
the respective distribution. The test shows that we could 
hit in worst-case targets of 24 mm diameter with one 

30 aspiration and 12 mm targets with three aspirations. 
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On average 13 mm targets can be hit with one 
aspiration and 5 mm targets with three aspirations. 

According to an embodiment of the present invention, a 
method for guiding blind biopsies includes preoperatively 
5 calculating parameter sets that describe how to handle the 
bronchoscope to maximize the success probability. During 
the intervention, the surgeon follows step-by-step 
instructions (protocol), which are based on the parameter 
sets, to perform a series of systematic needle aspirations. 

10 An important feature of this approach is its simplicity. A 
method according to the present invention does not need 
additional devices or computers that need to be calibrated 
or operated in the operating room. The method controls are 
passive, intuitive to operate and remain outside the body. 

15 After the intervention the controls can be easily removed 
and the bronchoscope can be sterilized as usual. A method 
according to the present invention can be real-time during 
the intervention, in contrast to some image based 
approaches. The surgeon operates at his/her own speed. Off- 

2 0 the- shelf bronchoscopes (fiber optic or video) are 

applicable to the present invention, as well as any other 
flexible device such as a catheter. Registration of a 
method can be based on one or more anatomical landmarks . 



2 5 repeatability is high enough to expect a maximum accuracy 
of 5 mm. Tests show that we are able to hit in worst-case 
targets of = 12 mm diameter ( average- case : 5 mm) with three 
aspirations . 



30 flexible cylinder, it is noted that modifications and 

variations can be made by persons skilled in the art in 
light of the above teachings. It is therefore to be 



Results with a lung phantom show that the 



Having described embodiments for a method of guiding a 
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understood that changes may be made in the particular 
embodiments of the invention disclosed which are within the 
scope and spirit of the invention as defined by the 
appended claims. Having thus described the invention with 
5 the details and particularity required by the patent laws, 
what is claimed and desired protected by Letters Patent is 
set forth in the appended claims. 
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